Perception experiment combining a parametric loudspeaker and a synthetic talking head
نویسندگان
چکیده
By combining the technologies of targeted audio and talking heads, a perception experiment was performed. Unvoiced consonants in a vowel context produced using speech synthesis were to be identified. It was found that the talking head could eliminate some of the confusions between consonants that occurred when the face was not present. The study also gave the possibility to analyse distortions of the speech signal due to the targeted audio device.
منابع مشابه
Evaluation of synthetic and natural Mandarin visual speech: Initial consonants, single vowels, and syllables
Although the auditory aspects of Mandarin speech are relatively more heavily-researched and well-known in the field, this study addresses its visual aspects by examining the perception of both Mandarin natural and synthetic visual speech. In perceptual experiments, the synthetic visual speech of a computer-animated Mandarin talking head was evaluated and subsequently improved. Also, the basic (...
متن کاملReactive Memories: An Interactive Talking-Head
We demonstrate a novel method for producing a synthetic talking head. The method is based on earlier work in which the behaviour of a synthetic individual is generated by reference to a probabilistic model of interactive behaviour within the visual domain such models are learnt automatically from typical interactions. We extend this work into a combined visual and auditory domain and employ a s...
متن کاملReactive Memories : An Interactive Talking - Head by Vincent E Devin & David C Hogg
We demonstrate a novel method for producing a synthetic talking head. The method is based on earlier work in which the behaviour of a synthetic individual is generated by reference to a probabilistic model of interactive behaviour within the visual domain such models are learnt automatically from typical interactions. We extend this work into a combined visual and auditory domain and employ a s...
متن کاملEvaluating a synthetic talking head using a dual task: Modality effects on speech understanding and cognitive load
The dual task is a data-rich paradigm for evaluating speech modes of a synthetic talking head. Three experiments manipulated auditory–visual (AV) and auditory-only (A-only) speech produced by text-to-speech synthesis from a talking head (Experiment 1—single task; Experiment 2—dual task), and natural speech produced by a human male similar in appearance to the talking head (Experiment 3—dual tas...
متن کاملCloning synthetic talking heads
The quality of Text-to-Visual-Speech synthesis is judged by how well it matches the visual perception of speech articulators with acoustic speech perception. Concurrently, di erent viewers often prefer di erent head models for subjective reasons. Traditional facial animation approach tied the parameterization of animation directly to the model. Switching the head model is di cult because a leng...
متن کامل